Analysis of Inhomogeneous Markov Reward Models
نویسندگان
چکیده
The majority of computational methods applied for the analysis of homogeneous Markov reward models (MRMs) are not applicable for the analysis of inhomogeneous MRMs. By the nature of inhomogeneous models only forward differential equations can be used to describe the model behaviour. In this paper we provide forward partial differential equations describing the distribution of reward measures of inhomogeneous MRMs. Based on this descriptions we introduce the set of ordinary differential equations that describes the behaviour of the moments of reward measures when it is possible. This description of moments allows the effective numerical analysis of rather large inhomogeneous MRMs. A numerical example demonstrates the application of inhomogeneous MRMs in practice and the numerical behaviour of the introduced analysis technique.
منابع مشابه
Analysis of Markov Reward Models with Partial Reward Loss Based on a Time Reverse Approach
There are effective numerical methods for the analysis of Markov reward models (MRMs) without or with complete reward loss, but the analysis of MRMs with partial reward loss is more complex. This paper presents the analytical description of the distribution and the moments of the accumulated reward of partial increment loss reward models and an effective numerical method to evaluate these measu...
متن کاملEvaluation of Battery Lifetimes using Inhomogeneous Markov Reward Models
The usage of mobile devices like cell phones, navigation systems, or laptop computers, is limited by the lifetime of the included batteries. This lifetimes depends naturally on the rate at which energy is consumed, however, it also depends on the usage pattern of the battery. Continuous drawing of a high current results in an excessive drop of residual capacity. However, during intervals with n...
متن کاملInhomogeneous perturbation and error bounds for the stationary performance of random walks in the quarter plane
A continuous-time random walk in the quarter plane with homogeneous transition rates is considered. Given a non-negative reward function on the state space, we are interested in the expected stationary performance. Since a direct derivation of the stationary probability distribution is not available in general, the performance is approximated by a perturbed random walk, whose transition rates o...
متن کاملComposite Performance and Dependability Analysis
Trivedi, K.S., J.M. Muppala, S.P. Woolet and B.R. Haverkort, Composite performance and dependability analysis, Performance Evaluation 14 (1992) 197-215. Composite performance and dependability analysis is gaining importance in the design of complex, fault-tolerant systems. Markov reward models are most commonly used for this purpose. In this paper, an introduction to Markov reward models includ...
متن کاملAggregation Methods for Markov Reward Chains with Fast and Silent Transitions
We analyze derivation of Markov reward chains from intermediate performance models that arise from formalisms for compositional performance analysis like stochastic process algebras, (generalized) stochastic Petri nets, etc. The intermediate models are typically extensions of continuous-time Markov reward chains with instantaneous labeled transitions. We give stochastic meaning to the intermedi...
متن کامل